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'A P e rformanc e Manag e ment Syst e m' 



JTRODUCTIQ N 



Field of th e Inv e ntion 



PERFORMANCE MANAGEMENT SYSTEM 



FIELD OF THE DISCLOSURE 
["0001] The inv e ntion disclosure relates to a performance management system for 
use in a processing environment in which the people resources account for a large 
proportion of the operational cost and therefore, associated costs and revenues are 
dependent on the successful management of the performance of this resource in terms of 
productivity, quality and b e haviou r behavior . 

Prior Art Discussio n 

DISCUSSION OF BACKGROUND INFORMATION 

r00021 Heretofore, much work has been carried out on development of contact 
eentfe -center functionality such as switches/ACDs, fax gateway, e-mail, web, Customer 
Relationship Management, quality and workforce management systems. For example, 
United States Patent Specification N o. US5206903 (AT & T) describes automatic call 
distribution equipment which routes calls according to agent skills. European Patent 
Specification No. 0740450A2 (IBM) also describes such a system. PCT Patent 
Specification No. WO99/60766 (Callscan) describes a system to optimize human resource 
allocation in a call eenfre -center environment. The system includes a knowledge base, a 
call activity monitor, and a performance reference model. 

["0003] All of t These developments to dat e focus on th e following cat e gori e s; : 

CONTACT MANAGEMEN T 

r0004] Contact Management. ACD's, Fax Gateways, IVR, E-Mail, Web - to 
manage and either automatically handle or route customer contacts according to 
configurable routing criteria. 
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WORKFORCE MANAGEM ENT 

[0005] Workforce Management. Workforce Management Systems - used 
primarily to forecast anticipated workloads and the scheduling of the corresponding 
resources required to achieve self-imposed service level goals. 

QUALITY ASSESSMENT 

[0006] Quality Assessment. Quality Systems - focused on the monitoring and 
evaluation of the quality of customer contacts. 

CUSTOMER RELATIONSHIP MANAGEMENT 

[0007] Customer Relationship Management. "CRM" Systems - focused on 
consolidating the different customer process systems into a single front-end and providing 
the employee with a contact history so that the customer queries can be handled better and 
resolved more efficiently. 

[00081 Whilst all of these systems have disparate primary functions, they all create 
detailed and important management information which form part of the overall picture of 
performance in an y organisatio n organization . 

Obj e cts of th e Inv e n tion 

l"00091 An object of the inv e ntion disclosure is to provide an organisation 
organization with a single source for performance measurement information and a 
configuration tool to allow an organisation organization to manipulate and exploit this data 
to provide all the users with a consolidated view of their own performance or that of their 
teams, departments, sites or business units. 



[00010] This is referred to in this specification as "information management". 
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["000111 A second objective is to provide the end-users (mainly agents, team leaders 
and managers) with a process for managing performance, the process comprising the 
following. 

[00012] Performance Review - to facilitate individual review of one's own 
performance. 

[00013] Appraisal management - to provide more consistency and objectivity 
around the review/appraisal process. 

[00014] Personal Development Plan - to ensure that all training and development 
efforts are more closely linked to the business objectives. 

[00015] Reward Manager - calculation of reward points and the administration of a 
gift process to promote improved fairness and staff motivation. 

[00016] The combination of these is referred to in this specification as "performance 
management". 

SUMMARY OF THE INVENTION 

SUMMARY OF THE DISCLOSURE 
[000 1 7] According to th e inv e ntion, th e r e is provid e d an embodiment of the 
disclosure a performance management system comprising: is provided. 

[000 1 8] The system includes configuration functions comprising: - 

a call eentre -center configuration function for configuring call eentre-center 
parameters in a configuration dataset, and 

a data dictionary function for formulating under user instruction, calculation rules, 
value inputs for rules and storage parameters for database fieldsf-. 
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["000191 a A_plurality of information management functions are provided, each 
comprising means for capturing raw data from an external customer services system, for 
processing said data, and for storing the processed data according to the data dictionary 
configuration^*^ 

[000201 a A^database is provided for storing processed data A and a user interfacejs 
provided comprising means for integrating with a configuration and information 
management functions. 

[000211 In one embodiment, the configuration functions comprise an objective 
wizard function for configuring objectives for employee and team performance. 

[000221 I n one embodiment, the objective wizard function comprises means for 
prompting input of objective description, appraisal definitions, and a rating calculation. 

[000231 In one embodiment, the configuration function comprise an objective group 
configuration function comprising means for defining under user instruction an objective 
group of objectives having the same appraisal definitions and weightings associated with 
objectives. 

[000241 In another embodiment, the configuration functions comprises a KPI wizard 
function comprising means for prompting user input of organisation organization -level 
ratings and thresholds. 

[000251 In a further embodiment, the configuration functions comprise a KPI group 
review configuration function comprising means for grouping KPIs together for reporting 
purposes, and the information management functions comprise a KPI group review 
function comprising means for outputting group review data. 
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r000261 In a further embodiment, the information management functions comprise a 
personal performance review function comprising means for allowing controlled agent 
access to personal performance data generated according to configured agent objectives. 

r00027] Preferably, the personal performance review function comprises means for 
allowing an agent to input comments associated with his or her personal performance data. 

r00028] In one embodiment, the personal performance review function comprises 
means for allowing a team leader to plan and record agent development against objectives, 
and for allowing an agent to access his or her personal development data. 

r000291 In one embodiment, the system further comprises functions for configuring 
and processing rewards in recognition of agent performance against objectives. 

r000301 In another embodiment, the user interface, the configuration functions, and 
the information management functions together have a structure of classes for instantiating 
objects in a visual layer, a business logic layer, and a data services layer. 

[0003 1 1 In one embodiment, the business logic class instantiates business logic 
objects having code of a configuration or an information function, and means for 
terminating the object at the end of a user session. 

F000321 In one embodiment, the business logic layer executes on a business server. 

[000331 In a further embodiment, wherein the data services layer comprises a class 
for instantiating data services objects residing on a database server and means for 
terminating said objects after a user session. 

[000341 In one embodiment, the system comprises a transaction server for executing 
data services layer functions. 
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[00035] In another embodiment, the transaction server comprises means for 
maintaining a pool of data services objects together and for maintaining a pool of database 
connections. 

[000361 In one embodiment, dynamic library links for the objects are registered 
using proxy stub pairs on both a client and a server. 

DETAILED DESCRIPTION OF THE INVENTION 

Bri e f D e scription of th e Inv e n tion 

BRIEF DESCRIPTION OF THE DRAWINGS 
[00037] The inv e ntion disclosure will be more clearly understood from the 
following description of some embodiments thereof, given by way of example only with 
reference to the accompanying drawings in which: 

[000381 Fig. 1 (a) is an overview block diagram of a performance management 
system of the invention; 

[000391 Fig. 1(b) is a diagram illustrating the physical architecture of the 
performance management system; 

[00040] Fig. 2(a) is a block diagram illustrating the main functions of the 
performance management system; and 

[0004 1 1 Figs. 3 to 7 are sample screen shots illustrating aspects of the performance 
management system. 



D e scription of th e Embodim e n ts 

DESCRIPTION OF THE EMBODIMENTS 
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[00042] The following description pertains to one or more specific example 
embodiments. Thus, described features may be for the described embodiment and need 
not be for other embodiments not expressly described herein. 

r000431 Referring to Fig. 1(a). there is shown a performance management system 1 
for the management of performance in a customer services environment and reporting on 
same. The system 1 interfaces with external performance measurement systems 2 
comprising a switch 3, a work force manager 4, and third party systems 5 that store 
performance measurement data within a structured database and can produce reports on 
either employee, application, departmental or organisational organizational p erformance. 
The external systems 2 do not form part of th e inv e ntion, how e v e r th e interface with these 
systems (API's and integration engine) ar e a part of th e inv e ntion , as they allow raw data 
to be formatted and imported into the performance management system. 

[000441 The system 1 comprises information management functions 6 which use 
data from a KPI (key performance indicator) table 10 and a results & ratings table 1 1 
within a database 9 to perform calculations pertaining to individual performance of 
employees, in addition to the overall performance within the customer services-eefrtfe 
center . The information management functions 6 interact with an HTML user interface 7 
to display to the end-user the results of the calculations performed on performance. The 
database 9 also contains configuration data tables 12. The contents of these tables allow 
the system 1 to be tailored to suit individual organisations organizations , thus minimizing 
the need for bespoke development of the system to suit particular business operations. The 
configuration data is captured through the use of configuration functions 8 and a 
Windows™-based interface 13, which provides the user with a GUI to specify the unique 
characteristics of the organisation organization . 

[00045] At a high level, the database 9 captures raw data from the external systems 
2 in a structured manner using APIs, however, flat-file reports may alternatively be used. 
The raw data is processed by an integration engine 1 8 according to requirements 
configured in the integration engine. The performance data is provided in real time via the 
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HTML user interface 7 in response to appropriate requests/enquiries. The performance 
data may relate to individual customer service agents, to teams, or to overall departments 
and even site locations. Performance is measured against objectives set up during 
configuration, and also against key performance indicators ( KPIs). Like objectives, KPIs 
have targets but are not rated. However they do not relate to persons, but instead to an 
organisation organization or department as a whole. 

["00046] The architecture of the system 1 is shown in Fig. 1(b). It has a three-tier 
architecture, which consists of includes a user interface layer 15 supporting the functions 7 
and 13, a business services layer 16 supporting the functions 6 and 8, and a data services 
layer 17 supporting the database 9. The functions are instantiated as objects from user 
interface, business logic, and a data services classes. Objects are instantiated for a task 
such as a user enquiry session and are terminated at the end. 

Us e r Int e rfac e Lav e ^ 4# 

[00047] User Interface Layer 15. There are two types of user interfacer-. 

[00048] - AVThe Browser Interface l._ 1 . This consists of includes a set of Web 
classes that reside on a Web server. 2. They send HTML to a client browser. 3. The 
primary role of the browser is to view the data in a variety of ways i.e. graphically, tabular, 
by day, by month, by year. 4. The browser front-end allows the measurement and 
management of performance. The measurement is by viewing the data in a variety of 
forms, and the management is by allowing the user to specify (according to his security 
privileges) targets, development plans, comments and even override results. 

[00049] S KThe Windows Interface 13. 1 . This consists of includes a set of forms 
which reside in the user interface layer 1 5. 2. It sends the configuration data directly to the 
business services layer, 3. The primary role of the Windows™ interface is to configure the 
browser and to determine the b e haviour behavior of the data within the system 1 . 4. The 
Windows interface allows 'tailoring* of the system to meet the specific requirements and 
characteristics of the contact management-eentFe center , thus omitting the need for 
expensive customization of the product. 
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Busin e ss S e rvic e s Lay e r 16 

[00050] Business Services Layer 16. The business services layer 16 has the 
following attributes: 1. It performs all calculations and all validations^ 2. It resides on a 
business server 

Data S e rvic e s Lay e r -4? 

[00051] Data Services Layer 17. The data services layer 17 has the following 
attributes: 1 . It accesses the database 8 for the required data^ 2. It resides on a data 
server 

r00052] A server process called "Overnights" is executed by the system every day. 
It has two main functions: 1 . It imports data from the external system 2 (KPI data can be 
imported every half hour whilst all other data is imported once a day). 2. It performs the 
performance management calculations (results & ratings calculations/recalculation^ 

[00053] The product is distributed over multiple servers. A Web server hosts the 
browser interface 7. This holds all of the ASP and Web Classes. 

[00054] A business server hosts all of the business objects of the business layer 17. 
All data processing occurs on this server and therefore this uses the most resources. The 
Windows™ GUI 13 directly accesses the business server 16, whilst the browser UI 7 
accesses the business server through the Web server. A data server hosts data services 
objects in addition to the actual database 9. The business server calls the data services 
object, which then in turn retrieve data from the database 9. 

Transaction S e rv e r (MTS) 

[00055] Transaction Server (MTS). The system 1 utilizes a transaction server in the 
following way: 1 . It handles all of the database transactions between the objects in the 
business layer and the objects in the data services layer 2. It holds a pool of objects 
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together 3. It maintains a pool of database connections,. 4. It allows improved scalability 
and performance. 



Dynamic Library Links (DLLs) are registered using proxy stub pairs on both the servers 
and en-the client. When a function 6 requires the DLL, the proxy stub pairs direct the 
function to the DLL stored on the server. The proxy stub pairs therefore enable the objects 
to communicate with each other across multiple servers. 



[00056] Referring now to Fig. 2, the configuration functions 8 include: 



20 Call C e ntr e Center Configuration 

2 1 Hierarchy Maintenance 

22 . Data dictionary maintenance 

23 Employee Maintenance Utility 

24 Appraisal rating Group Configuration 

25 Performance Exception Codes 

["000571 The information management functions 6 include: 



30 Personal Development Status Configuration 

3 1 Personal Development Action Configuration 

32 Skill Configuration 

33 Personal Development Plan 



40 Reward Configuration Utility 

41 Reward Statement & Ordering 

42 Reward Manager Utility 

43 Reward Points Editor 

50 Objective Wizard 

51 Objective Group Configuration 
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60 Manual Results Entry 

6 1 Performance Review 

62 Manual Ratings Entry 

70 Appraisal Manager Configuration 

71 Appraisal Manager 

80 Report Manager Configuration 

81 Report Manager 

[00058] The call centre -center configuration function 20 is used via the Windows™ 
interface to construct the conceptual organisational organizational hierarchy. The 
organisation organization can configure up to ten hierarchical levels. Fig. 3(a) shows an 
example for an organisation organization that has seven levels from agent through to the 
global organisation organization view. The screen of Fig. 3(b) then allows the user to 
determine functional access (at the browser end) to the various performance management 
functions for each level as specified in the system hierarchy in Fig. 3(a). This is inputted in 
a simple Yes/No cellular structure. Because the defined organisational organizational 
hierarchy forms a basis for the operation of many other functions, amendments to the same 
can only be made by a senior systems administrator with the appropriate access and user 
rights. 

[000591 The function 20 is coded in Visual Basic™ and refers to the characteristics 
of the customer services-centre center . After the call centre- center configuration has been 
defined^ a hierarchy configuration is then set up for each site using the function 21 . The 
fields completed for site configuration are call centre -center name, call centre - center ID, 
year and week start values, system days, close off data, currency mask and a moratorium 
value. 
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[00060] The data dictionary maintenance function 22 allows users to manipulate the 
measurement data that has been imported from the third party performance measurement 
systems. The primary purpose is to formulate the performance management system 
objective fields from all the data fields imported from the external third party databases or 
performance measurement systems. A sample screen is shown in Fig. 4(a) 5 in which the 
user is creating a new data dictionary field that forms the measurement of schedule 
adherence (the percentage of time an agent actually spends signed-on to their phone 
against the time they were scheduled to be there). As illustrated, the user inputs a name 
description, associates the data dictionary field to a level in the hierarchy, and specifies the 
period against which the measurement data is captured. The level must be chosen from the 
set established when creating the organisation organization h ierarchy. A second screen, 
shown in Fig. 4(b), is used to assign the data dictionary name to a database field or a 
combination of database fields and defining how these fields are to be calculated. The 
calculation is defined by a Value 1 /Operator /Value 2 sequence. In the example Fig. 4(b), 
the user selects the field [fgn_value5] which relates to the actual time the agent was 
signed-in (taken from the ACD) and divides this by [fgn_value21] which relates to the 
amount of time they had been scheduled to be signed-in (taken from the Workforce 
Management System). 



["000611 The following table sets out the field descriptions in more detail. 



Field Name 


Mandatory / 
Optional 


Field 

Behaviour 
Behavior 


Field Description 


Field 




Displayed 


This column displays the database fields that 
may be entered. 


Description 




Displayed 


This column displays the description 
associated with the field. This cannot be 
edited by the user within the DDM 22 as it is 
display only. It is stored within the DDM. 
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Valuel 


M 


Input 


This fields allows the user to enter the 
summation formula for the summary periods. 
A result will be produced for all periods 
regardless of whether the period was chosen 
as a rating period in the objective wizard 
function. 
Supported 

All approved ANSI 92 SQL Statements^ 

The result of this part of the formula will be 
stored in the database and used to sum results 
for period and teams,. 


Operator 


O 

Mandatory if 
Value2 is 
entered 


Selection 


This operator makes up the complete formula 
using Valuel and Value2. Initially the data 
from the foreign data table is calculated using 
the full formula. To calculate the sum for 
periods and teams, the formula Valuel 
Operator Value2 will be used. 
Available operators 


Value2 


O 


Input 


This fields allows the user enter the second 
part of the Summation Formula. This field 
may not be required for similar formulae of a 
field assignment. 
Supported 

All approved ANSI 92 SQL Statements 

The result of this part of the formula will be 
stored in the database and used to sum results 
for period and teams 


Result 




Display 


Displays the result of an expression based on 
skeleton data, when the TEST' option is 
selected. 



[00062] The following table sets out the command options. 



Command Name 


Description 


TEST 


This allows the user to test the full formula entered. A result of the 
Formula is displayed from skeleton test data in the database. 


OK 


Saves any changes / additions made by the user without prompting for 
confirmation of same; and quits component / application. 


CANCEL 


If change / additions made, prompts user to save same; otherwise quits 
component / application. 


HELP 


Opens Help file for component. 
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r000631 Fig. 4(c) shows the input screen used to define the data dictionary rules. 
These rules define how the result for the field is entered, displayed, and calculated. As 
illustrated in Fig. 4(c) the minimum and maximum values are set, as is the display mask. In 
this case a ##% means that the result will be displayed as a % and rounded up with no 
decimal places. The over-ride check box allows the organisation organization to control 
whether or not these results can be over-ridden by a user's manager. The following table 
describes the inputs in more detail. 



Field Name 


Mandatory / 
Optional 


Field 

BehaviourBe 
havior 


Field Description 


Min Value 


O 


Input, 


This field is used to restrict the input 
permitted for a manual data entry or a result 
override. The value entered must be greater 
than or equal to this value. 


Max Value 


o 


Input 


This field is used to restrict the input 
permitted for a manual data entry or a result 
override. The value entered must be less than 
or equal to this value. 


Display Mask 


o 


Input 


Determines how the result for the data 
dictionary field will be displayed. Used to 
indicate currency, percentage, minutes or 
seconds. 


KPI 


o 


Check 


Indicates that this data dictionary field will 
be used in conjunction with KPFs and not 
objectives^ 


Manual 


o 


Check 


Indicates that this data dictionary field will 
require a manager to enter a result manually 
and that data will not be populated 
automatically from the switch. 


Override 


o 


Check 


Indicates that results for this data dictionary 
field cannot be over-ridden in the team 
performance review screen. This field will be 
used where the formula for the data 
dictionary is deemed te-too complicated to 
allow values to be changed. 



[00064] T he following are the command options. 
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Command Name 


Description 


OK 


Saves any changes / additions made by the user without prompting for 
confirmation of same; and quits component / application. 


CANCEL 


If change / additions made, prompts user to save same; otherwise quits 
component / application. 


HELP 


Opens Help file for component, if in WinHelp then the topic is 
generally (but not always) specific to the tab / component the user is 
currently using. 



[00065] The following are the business rules. 



Description 


If the data dictionary created is to be used to provide data for the 
key performance indicators (KPI's), then it must be entered above 
the highest level specified. 


Reason 


Entering the data dictionary that is to be used in conjunction with a 
KPI at the highest level 


Typical 
Scenario 


A data dictionary is to be created for Average Handling Time ? . this 
This will also be later used as a Key Performance Indicator. The 
level for the AHT would have be is the level higher than the 
highest level specified in Hierarchy Maintenance, i.e.: if the highest 
level in Hierarchv Maintenance was ' OrganisationOrganization' at 
Level 7, then the Data Dictionary for AHT must be ig_specified at 
Level 8. 


T000661 The following are the best practices. 


Description 


The display mask must be configured to reflect the maximum 
characters as specified in the 'Max Value' field, i.e. if the 
maximum value is 4 characters (1000) then the display mask must 
provide provision for 4 characters (###0). 


Reason 


The input mask must provide provision for all the characters 
entered into the data dictionary field.. 


Typical 
Scenario 


A manual entry data dictionary is set-up called 'revenue', which 
will have a maximum amount of £1,000,000. The call eentfe-center 
wish this to be displayed with commas separating every 3 
characters, a sign and to 2 decimal places, therefore the input 
mask is specified as '£#,###,##0.00, 



[000671 The employee maintenance utility 23 creates an employee (agent). The 
inputs include name, password, password confirm, organisation organization hierarchv 
level, a manager to whom the employee reports, an ID, an objective group of which the 
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employee is a member, a team name, a flag indicating whether KPI data will be attributed 
to the employee, addresses, system ID, and any additional information. The following 
business rules are applied to employee creation, objective creation, and objective 
modification. 



[000681 Employee Creation 



Description 


Before assigning an employee, a manager, team name or objective 
group, the employee must be assigned a level. 


Reason 


The level determines the possible managers, teams and objectives 
that the employee could be assigned. 


Typical 
Scenario 


An employee is assigned to manager 'X\ belongs to team ' Y' and 
has objective group 'Z\ Before any of these are specified the 
employee must be assigned a level such as 'Agent'. 


r000691 Objective Creation 


Description 


All employees that share the same manager must be of the same 
level and the same appraisal group. 


Reason 


The svstem 1 only allows provision for a manger manager to 
manage employees of a single level. Employees must share the 
same appraisal group as the performance review assumes only one 
appraisal group throughout the team. 


Typical 
Scenario 


As employees are entered onto the system 1 and assigned 
managers, only those at the same level and who share the same 
appraisal group will be allowed to be entered into the same team. 


r000701 Objective Modification 


Description 


An employee's objective group can be amended after it has been 
specified. In the event of an employee's objective group being is 
amended more than once in a single day, all intermediate objective 
groups will be deleted and all results and ratings will be attributed 
to the final objective group. 


Reason 


Each objective is specified to an employee. When a new objective 
is assigned, the current date is attributed to the start date of the new 
objective. The previous objectives end date is set as the previous 
days date. 
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Typical 
Scenario 



The firm intends to move an employee from objective group 'A' to 
objective group 'B\ however it accidentally moves the employee to 
objective group C C. The mistake is later rectified on the same 
working day, and any results and ratings that were collected and 
attributed for objective group ft C will be reallocated to objective 
group 'B'. 



r000711 The appraisal rating group configuration function 24 allows the user to 
define appraisal rating groups. Each group can have up to ten appraisal ratings, which will 
be used wh e n to rate individual employee's objectives. 

[00072] The review periods available for the system are also defined within this 
utility. These review periods dictate the 'period selection tabs' displayed in functions such 
as personal performance review and appraisal manager, as w e ll as and dictate the periods 
(apart from daily and weekly) when ratings can occur as set out in the objective wizard 
function. 

I"000731 The user creates the appraisal rating groups and these will be used 
throughout the system. These appraisal ratings form an integral part of the system. 
Separate appraisal rating groups weuk knay b e set up where a different function in the 
organisation organization might wish to rate individuals in a different fashion. 

[000741 The input screen defines an appraisal rating group and the appraisal review 
periods that apply to it. This screen allows the user to configure appraisal rating groups 
which are used in conjunction with objective wizard, objective group configuration - 
objective group rating, appraisal manager, personal performance review. The user 
configures appraisal rating groups, which appear on all the above screens. There is a 
maximum of ten Appraisal Ratings per group and more than one appraisal rating group can 
be created. The users must ensure that they select all the review periods required for all 
objectives i.e.: they might only have a requirement to review sickness and absence at the 6- 
month juncture. However, they must select 6 month and it will apply to all. The review 
period is by appraisal group and not by objective. 
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r000751 The performance exception codes configuration function 25 allows the user 
to configure standard codes which can be used by an individual's manager to over-ride 
their performance for given reasons like system issues, health, etc. This functionality 
ensures that the system 1 allows discretionary management decisions within the 
organisation organization b ut has a means of tracking and reporting on these. 

r000761 The basic principle behind this is that the agents (and team leaders) take 
responsibility for their own performance and enter comments against their performance 
(good or bad) in personal performance review. The manager then has the ability to 
exclude/override the result for that day from their overall result and from any averages. 
They must however enter a code for the exception; this will be reported to management 
and will highlight the various reasons for excluding bad results. This screen is the 
configuration screen to set up the standard reason codes and is mainly used during the 
initial system installation. Ongoing changes or additions may be needed as the conditions 
change. 

F000771 An objective wizard function 50 defines an objective. An objective is a 
performance expectation assigned to an individual and is set up using the objective wizard 
50. The wizard function 50 prompts input of the following values. 



Field Name 


Mand. / 
Opt. 


Field Behaviour 
Behavior 


Field Description 


Objective 
Name 


M 


Input 


Name of new objective e.g. average 
handling time.. 


Description 


M 


Input 


Free- format textual narrative explains 
the overall purpose of the objective. 


Appraisal 

Rating 

Group 


M 


Input ~ Pre- 
defined List 


This field allows a user to assign an 
appraisal rating group to an objective, 
thereby allowing the user to review and 
appraise many objectives together. 


Objective 
Class 


0 


Input — Pre- 
defined List 


This field allows the user to associate 
an objective class with an objective. It 
allows the user to class/sort objectives 
for reporting purposes only. 
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r000781 A next step prompts input of data indicating the source of data for the 
objective. The following are the inputs. 



Field Name 


Field 

Behaviour 
Behavior 


Field Description 


Rating - 
Calculated 


Option 


The rating will be calculated by an overnight process 
based on results and rating methods.. 


Rating - 
Manual 


Option 


The rating be will manually entered by a team leader or 
manager for each target period (as specified on the next 
screen). This rating will be added together for periods 
greater than the target period. 

When this entry is selected, no data dictionary field 
needs to be selected as we are giving a rating for the 
objective and no data or results are required to compute 
the rating. The data dictionary and result type section 
will be disabled. The rating will always by applied to 
individuals. 

The additional rating periods category in a next screen 
will be disabled. The target period will define the 
period for which manual rating is entered. 

After the target period is selected in the following 
screen, the final screen, "Finished", will be presented 
in the objective wizard function. 


DDField- 
Standard 


Option 


The measurement data is automatically captured - from 
the ACD Switch for example. The drop down will list 
only non-KPI, non-manual data dictionary items. 


Manual 
Result Entry 


Option 


The user will have to key in the result, which will be 
used in the objective. The drop-down will list only non- 
KPI, manual data dictionary items. 


DD Field - 
Drop Down 


Selection 


Lists All data dictionary fields that are not set up for 
ICPI and are manual onlv if the Manual Ontion is 
selected. 

The data dictionary field defines the Measurement 
Period for the objective. One cannot select a target or 
rating period lower than this measurement period. 


Result based 
upon 

Individual 


Option 


The objective will use an individual result when 
calculating the rating. Objectives of this type may only 
be assigned to employees at the same level as the data 
dictionary field associated with the objective, or a 
higher level. 
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Field Name 


Field 

Behaviour 
Behavior 


Field Description 


Result based 
upon 

R ennrtee 

Team 


Option 


This is, in effect, the same as Individual results. 
Individual and reportee team are treated the same by 
the wstem Starting at the level associated with the data 
dictionary field, results are always summed up into 
teams. The team result for Level 1 becomes the 
individual result for Level 2 and so on. This field 
makes it clearer to the user what type of objective is 
being set up. 


Result based 
upon Peer 
Team 


Option 


The objective will use the team result when calculating 
the rating. Objectives of this type may only be assigned 
to employees at the same level as the data dictionary 
field associated with the objective or, employees at a 
level higher than the data dictionary level. The 
objective is always, in-effect a peer objective, i.e. the 
employee will be rated on the result of the team that he 
is part of. The result and rating that he will see will be 
stored on the database with his manager. 

When these objectives are assigned to team members, 
pseudo objectives are assigned to the team leader. No 
calculation of ratings is performed for the team 
members, but rather they see the result and rating for 
the team that is assigned with the team leader. 

If team peer result is selected, the objective will only 
be rating using absolute values; i.e. the rating method 
screen will not be shown and absolute only will be 
assumed. 



F000791 The wizard 50 then proceeds to prompt input of rating periods, rating 
methods, absolute thresholds, and te-improvement thresholds. For example, the rating 
method maybe based on either an absolute result or a percentage improvement on the 
initial target set. 



("000801 The objective group configuration function 51 allows users to create and 
administer objective groups for the purposes of easy handling of objectives. The only 
constraint for groups is that the objectives have the same appraisal definitions. The 
objective group is defined by: 

- name, 
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- selected appraisal rating group, 

- description, and 

- objectives within the group. 

[00081] The function 51 also allows a percentage weighting to be applied to each 
objective within the group. Also, random sample ratings may be applied to each objective. 

r000821 The KPI configuration functions 52, 53, and 54 allow users to define all the 
key performance indicators associated with the call eentre -center or a subset of the call 
eetrtFe -center such as customer services. The KPIs are similar to objectives except that they 
are not assigned to individuals and are not rated. They are merely used to report status. 
Typical KPIs are Service Level, Abandon Rate, Number of Calls, Total Revenue etc. If the 
system 2 has been configured to have more than one Skill Groups e.g.^ Customer Services 
and Telesales, then there is a group of KPIs for each of these^ i.e.: Customer Service 
Level, Telesales Service Level. The KPI data can often be more frequent than employee 
objective data, which has a minimum measurement period of one day. The system 2 
typically produces service level and other information associated with skill groups (also 
called applications or queues) every half-hour. This means that the system receives half- 
hourly KPI data from the customer services system 2. 

r000831 The KPI's are not rated but they have a target for reference purposes. For 
example, a call eentre -center m ight state that the abandon rate target is 5% or less. This can 
then be shown on a graph or report alongside the actual data to show how the call c e ntre 
center is performing. 

r000841 The KPI wizard 52 prompts definition of: 
KPI name and description, 
a static target for each month, 
additional targets, and 
rules. 
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[000851 In a typical scenario, a manager wishes to see the Abandon rate for the call 
centre -center on an intra daily basis. A KPI will be set-up- set up to capture this data, and 
the results will be reviewed via the KPI group review utility. aad-tThese results are 
presented in tabular or graphical format. For an effective call eentre -center the manager 
requires that the Abandon rate is no more than 5%. Therefore, he would enter 5% in the 
target. As the manager would like to view this on an intra-day basis, the intra-day, daily 
and weekly check boxes would need to be ticked. 

[00086] Regarding targets, in a typical scenario a manager wishes to see the days 
taken absent due to sickness for the call centre -center on a yearly basis. A KPI will be-set 
up set up to capture this data, and the results will be reviewed via the KPI Group Review 
utility, and th e s e These results are presented in tabular or graphical format. If the manager 
wishes to specify the target for the number of days taken absent due to sickness as 40 in a 
year, the manager would then need to specify in the yearly column the target of 40. If the 
manager wanted to view the achievement of the target on a quarterly or half yearly basis, 
then the values of 1 0 would be needed to be entered for each quarter and the value of 20 
for each half year. This also allows the manager to weight the absences (i.e. allow more 
absences in the winter months than the summer months). 

[000871 Regarding the rules, in a typical scenario a mang e r manager wishes to 
specify the target for the abandon rate as no more than 5%^ therefore, the manger m anager 
would need to set-up a KPI for abandon rate and specify the target as 5%. The manager 
would then need to check the "<=" box, thus informing the system 1 that any value below 
the 5% target would be considered as meeting the target. The manager would then need to 
specify how the next years -year's targets for the KPI would be calculated. 

r000881 The KPI group review configuration function 53 "allows a user to group a 
number of KPIs together for reporting purposes. The KPI group review function 54 allows 
viewing of KPI data as set up by the wizard 52. The functions 52, 53, and 54 all operate 
with the KPI table 14, which is dedicated to KPI data only. 
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[000891 The performance appraisal manager configuration function 70 allows s e t up 
set up of an appraisal rating group, a review/appraisal process, and additional information 
which are then used by the Appraisal Manager 71 for review and appraisal purposes. 

[00090] The performance appraisal manager is used as an on-line tool for individual 
performance appraisal and review. It is the view of the overall performance achievements 
of the individual, by performance review periods, for a particular year. 

[000911 These performance review periods are set up via an appraisal rating group 
configuration utility and are presented as tabs on the appraisal manager function 71 in the 
browser. 

[000921 The year can be changed at any time. The information contained within this 
function is directly fed into the appraisal summary report. Referring to Fig. 5 one of the 
screens of the function 71 is shown. This screen outlines the appraisal process and 
specifies the objective ratings for the individual selected. 

[000931 A manual results entry function 60 allows manual input of results by agents 
or team leaders. The performance review function 61 allows the user to view performance 
data relating to their own personal objectives i.e.: those objectives within their assigned 
objective group. It shows the overall rating for the individual as well we-as the individual's 
targets, aad-results^ and ratings for each objective. Targets and ratings are only displayed 
if the review period selected^ i.e.^ daily, weekly tab, is defined as a rating period for the 
objective. The user can review their performance against objectives on a daily and weekly 
basis as well as for the review periods as defined in the appraisal rating group 
Configuration. A user can review historical data against the period selected, i.e.r 4 if they 
are looking at weekly data, then they can review historically by week^ and 4 if daily^ then by 
day, but only in keeping with the archiving rules for the data. If the daily tab is selected 
and today is 1/2/99, they cannot view their performance for 1/10/98 if daily data is 
archived after 30 days. This function will normally be used by agents, team leaders and 
managers (it is improbable that organisations organizations may set objectives such as 
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these for senior managers or directors) to review only their own personal objectives and to 
see how their individual performance compares to that of their team which is also 
displayed. This function also allows an individual agent to input a comment against their 
performance for a particular objective. An individual can only comment against a result for 
an objective's measurement period (defined by the data dictionary maintenance function 
22), i.e.: if an objective is measured weekly and the agent wishes tee-to comment on why a 
bad result was achieved then he/she may only do so on the weekly tab. 

[00094] The personal development status configuration function 30 allows a user to 
edit an existing status available in a personal development plan 33. The plan 33 is 
dedicated to allowing a manager or team leader to plan and record agent development 
modules against specific objectives. Each user may view his or her own personal 
development and the history of associated actions. Referring to Fig. 6, the function 33 
displays the skill that requires a development plan and the action that has been assigned to 
the skill with the status of the action. This allows reports to be executed for the relevant 
department (HR, accounts, team leaders, training etc.) giving them the status on the 
relevant skills for relevant actions, thus allowing them to make the necessary 
arrangements. The screen allows the user to monitor the progress of individuals and the 
effects of the actions on their objectives. 

[00095] In a typical scenario, a team leader wishes to set an action for an agent who 
is having problems meeting his Average Handling Time targets. The team leader moves 
into the relevant agent's screen by selecting his name from the name field in the main 
browserA The team leader then selects AHT from the objective drop-down menu. The 
team leader identifies the skill area requiring development as the 'Closing' skill, and 
selects this from the drop down combo, he then sees that so far the actions that have been 
given to the agent to aid his AHT have been a 'self-learning' program and a 'buddy 
session'. As these seem to have not been successful, the team leader decided to enter the 
agent onto a 'workshop'. 
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r000961 The training department then executes a report for the amount of AHT 
workshops that have been requested. Once they see that the number is sufficient, they 
request a workshop to be held. 

[00097] The reward functions 40 to 43 enable the organisation organization to 
automate a points and gifts reward process. Points can be assigned to ratings of individual 
objectives and using these an individual can then choose their own gift when they want it. 
These gifts are configurable by the organisation organization . The reward configuration 
utility 40 allows a user to assign points to reward prizes. The reward statement and 
ordering function 41 allows each individual user to both view the points they have 
accumulated and to order from the different rewards on offer. It also provides a statement 
to the user (similar to a bank statement) showing how many points they have, how they 
received them and any transactions (purchases) which occurred. The principle behind this 
utility is the concept of reward and recognition. It does so by providing immediate reward 
for effort. These points/prizes systems have previously taken much administrative effort. 

[00098] The reward functions handle this administration and offer call c e ntr e s 
centers an easy-to-manage mechanism for introducing (and tailoring) their own reward 
system. The 30 reward system can be on a personal basis (where the individuals are 
awarded points individually) or this can be done for the team. A call eentre -center may 
introduce a competition in which the first team to gain 1 500 points wins a trip to Paris for 
the weekend, with the aim of building teamwork and hence strengthening the team. The 
reward and recognition module will provide a means of monitoring the progress of each 
group. 

[000991 Typically, agents and team leaders will receive reward points for exceeding 
individual objectives. The reward system manages and awards the points. The call c e ntre 
center can configure the rewards (cash, tickets, wine etc.) and set the number of points for 
each reward. Users earn points; and can then buy the rewards when they have enough 
points. As shown in Fig. 7 (a), the function 41 provider the user with a detailed breakdown 
of amendments to points. 
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[000100"! The points can be amended in three ways: 



1) 



Points awarded/ deducted/ amended by the rating given to an objective, 
either automated or manual. 



2) 
3) 



Points deducted/ added for the 'Purchase' or 'Refund' of items. 



Points added/ deducted by the Reward Point Editor. 



[0001011 The purpose is to allow the agent to see what benefits their strengths have 
given them and what costs their weaknesses have brought, hence encouraging them to 
focus on their weaknesses and maintain their strengths. The screen also provides the agent 
with information pertaining to any transactions that they have made or are pending and 
provides them with the cost (in points) of the item they purchased. Any comments 
pertaining to a transaction in the statement can also be viewed. 

[000102] The ratings are added to the screen on the date that they are rated, and hence 
a monthly objective will only be displayed on the screen when it has been rated and 30 
points have been allocated to it. As the ratings are carried out on a daily basis, the 
archiving principle will dictate how many days data is viewed in the 'Statement' screen, 
i.e.: If the archive period is defined as "60" in the call eentre -center configuration, then 60 
days data will be viewable in the reward manager statement screen. 

[000103] The reward manager utility function 42 acts as an administration tool for all 
items ordered by employees. It allows the reward administrator to change the status of all 
orders which is then communicated back to individuals via function 41 . A sample screen 
is shown in Fig. 7(b). 

[000104] The reward points editor function 43 allows a user to manually adjust the 
points (by adding or subtracting) of a specific user. The main purpose of this screen is to 
allow flexibility in the reward system. Typically this screen is used to allow the team 
leaders and managers to reward behaviour b ehavior which is not measured by the system. 
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These team leaders and managers have discretion over how they manage the reward 1 5 
system and the points so that the reward system is not seen as taking the discretion of 
responsibility away from people. 

[000105] The team leaders and managers may also use this to reward people where 
there is no set objective against the action, (i.e. a customer phones in stating that they were 
pleased with the service they received from an agent). 

[000106] It will be appreciated that the inv e ntion disclosure presents embodiments 
that p rovides for effective centralized performance measurement and reporting, while also 
greatly assisting with people management in a flexible manner. The illustrated system also 
provides for automated appraisal and reward administration. The ability of agents to view 
their own development data is very significant as it enhances team participation. 

[0001 07] Th e inv e ntion is not limit e d to the Other embodiments not expressly 
described^ but may b e vari e d e.g., including variations in construction and detail , are 
contemplated by this disclosure, such as may be within the scope of the claims. 

What is claimed is: 
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